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About this document 

This section describes the following topics: 

• Application notes information 

• Intended audience 

• Other documentation 

Application notes information 

These application notes describe the following: 

• MPxIO overview, page 3 

• New features, page 3 

• Supported hardware and software, page 4 

• Preparing the host system, page 5 

• Configure and verify the host, page 6 

• Enabling MPxIO, page 8 

• Verify the MPxIO configuration, page 9 

Intended audience 

This document is intended for customers who are using Sun Solaris MPxIO with HP storage systems. 

Other documentation 

A complete library of related documentation is available at: 

http://hl 8006.wwwl .hp.com/storaqe/saninfrastructure.html . 

For Solaris 8 & 9, the following documentation is available at http://www.sun.com/ products-n-solutions/ 
hardware/docs/Network_Storaqe_Solutions/SAN/san_software/index.htm : 

• Sun StorEdge SAN Foundation Software 4.4 Installation Guide 

• Sun StorEdge SAN Foundation Software 4.4 Configuration Guide 

• Sun StorEdge SAN Foundation Software 4.4.x Release Notes, including Sun StorEdge Traffic 
Manager for the Solaris Operating System 

• Sun StorEdge Traffic Manager Installation and Configuration Guide For the Solaris Operating System 

• Sun StorEdge SAN Foundation Software 4.4 

For Solaris 10, the Solaris Fibre Channel and Storage Multipathing Administration Guide is available at 

http://docs.sun.com/app/docs/doc/81 9-01 39 . 

MPxIO overview 

MPxIO provides basic failover and load-balancing capability to HP StorageWorks EVA3000/5000 v4, 
EVA4000/6000/8000, and the XP line of storage systems. Different storage devices can connect to the 
same system. Failover to other storage devices is allowed. 

New features 

This release provides support for Sun Solaris MPxIO multipathing on EVA3000/5000 4.004 and 
EVA4000/6000/8000 disk arrays. 
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if NOTE: 

MPxIO is not supported on versions of the EVA3000/5000 prior to 4.004. 



Supported hardware and software 

Table 1 describes supported hardware and software. 



Table 1 Supported hardware and software 



Component 


Version 


Operating system 


Solaris 8, 9, 10 


Sun native adapters 


SG-XPCN FC-QF2 (X6767A) 




SG-XPCI2FC-QF2 (X6768A) 




SG-XPCI2FC-QF2-Z 




SG-XPCN FGQF4 




SG-XPCI2FGQF4 




SG-XPCIE1 FGQF4 (Solaris 10 only) 




SG-XPCIE2FGQF4 (Solaris 10 only) 




SG-XPCN FGQL2 




SG-XPCN FGEM2 




SG-XPCI2FC-EM2 




bCj-XrLIb 1 r(_-bM4 (oolaris 1 0 only) 




o(j7-Ardtzrc-t/V\4 (oolaris lUonlyj 


QLogic adapters 


QLA2310F 




QLA2340 




QLA2342 




QLA2460 




QLA2462 


Emulex adapters 


LP 10000 




LP10000DC 




LP 1 1000 




LP 1 1002 


Storage Systems 


HP StorageWorks EVA3000/5000 4.004 




HP StorageWorks EVA4000/6000/8000 




HP StorageWorks XP48/51 2 




HP StorageWorks XP1 28/1 024 




HP StorageWorks XP1 0000/1 2000 



Supported multipathing combinations 

The combination of MPxIO and Secure Path on the same server can only be supported if FCA2257P is 
used for Secure Path and Sun native or Emulex adapters are used for MPxIO. 

To view more multipathing combinations supported by MPxIO, go to http://www.hp.com/qo/ 
sandesiqnquide . From the web page, select the complete HP StorageWorks SAN design reference guide 
(1-5) and check the table Sun Solaris multipathing coexistence support. 
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Preparing the host system 

To set up the host system: 

1. For Solaris 8 & 9 and Fibre Channel Adapters (FCAs) from Sun or QLogic: 

If the OS has been installed before adding QLogic based FCAs, you may need to install SUNWqlc 
and SUNWqlcx first. Go to http://sunsolve.sun.com (and select Document id 74507) for further 
details. 

2. Install the necessary software components for the different Solaris versions: 

a. For Solaris 8 and 9, download the Sun SAN Foundation Software (SFS) 4.4.8 or later, 
SAN_4.4.x_install_it.tar.Z which includes all the patches. Install it with the included 
install_it script, available at http://www.sun.com/storaaetek/storage networking/ by 
selecting SAN 4.4 release Software/Firmware Upgrades & Documentation. To verify which 
version of SFS has been installed, go to http:/ / sunsolve.sun.com (see Document id 77230). 

b. For Solaris 10, the reguired patches depend on the FCA. 

• With QLogic based FCAs (from Sun or QLogic) SUNWglc with Patch 1 1 91 30-1 6 or later 
is reguired 

• With Emulex based FCAs (from Sun or Emulex), SUNWemlxs and SUNWemlxu with Patch 
1 20222-08 or later is reguired 

• Use /usr/bin/updatemanager (see http:/ / www.sun.com/ service/ sunupdate/) to 
update to the current Sun SAN patch level 

3. Reboot the Host after installing the (software and) patches. 

4. Upgrade each FCA to the latest FCA Fcode/OpenBoot if reguired (typically reguires single user 
mode and no I/O activity): 

• For FCAs from Sun, go to http://sunsolve.sun.com/ or check with Sun if the FCA reguires an 
fcode update and follow the instructions in the patch description in case a patch is available 

• For native Emulex FCAs, check the Emulex web site ( http://www.emulex.com) for the latest 
OpenBoot version for the given FCA. Download the fcode and FCA utilities from that web site 
and use /opt/EMLXemlxu/bin/emlxadm to check and update the fcode 

• For native QLogic FCAs, check the QLogic web site at http:/ / www.glogic.com for the 
latest glc Fcode. Download the fcode and SANSurfer CLI from that web site and use 

/opt/QLogic_Corporation/SANsurferCLl/scli to check and update the fcode 

5. Reboot the Host after updating the Fcode on the FCAs 
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Configure and verify the host 



Verifying configuration settings 

Verify that all paths to the storage system are present with cf gadm -al command. To display the LUNs 
configured to each path, execute cfgadm -al -o show_FCP_dev as shown in the example below. 

The following examples are with 4 paths (ports) visible from the array on the host and with 2 LUNs 
configured on the array for the host. You should normally see 4 paths with EVA3000/ EVA5000/ 
EVA4000/ EVA6000, however you might also see up to 8 paths with EVA8000. 

1. Enter the cfgadm command to verify the paths to the LUNs (note that you need to have 
configured LUNs on the array for the host in order to see the "disk" lines): 



Example: # cfgadm -al -o show_FCP_dev 



Ap_ 


.Id 


Type 




Receptacle 


Occupant 


Condition 


c2 




f c-f abric 


connected 


unconfigured 


unknown 


c2 




50001fel002709f8, 0 


array- 


Ctrl 


connected 


unconfigured 


unknown 


c2 




50001fel002709f8, 1 


disk 




connected 


unconfigured 


unknown 


c2 




50001fel002709f8, 2 


disk 




connected 


unconfigured 


unknown 


c2 




50001fel002709fc, 0 


array- 


Ctrl 


connected 


unconfigured 


unknown 


c2 




50001fel002709fc, 1 


disk 




connected 


unconfigured 


unknown 


c2 




50001fel002709fc, 2 


disk 




connected 


unconfigured 


unknown 


c3 




c-f abric 


connected 


unconfigured 


unknown 


c3: 


50001fel002709f 9, 0 


array- 


Ctrl 


connected 


unconfigured 


unknown 


c3: 


50001fel002709f 9, 1 


disk 




connected 


unconfigured 


unknown 


c3: 


50001fel002709f 9, 2 


disk 




connected 


unconfigured 


unknown 


c3: 


50001fel002709fd, 0 


array- 


Ctrl 


connected 


unconfigured 


unknown 


c3: 


50001fel002709fd, 1 


disk 




connected 


unconfigured 


unknown 


c3: 


50001fel002709fd, 2 


disk 




connected 


unconfigured 


unknown 



With Solaris 8 or 9, the Occupant status will be displayed as above in a SAN environment. 
With Solaris 1 0, you will see a "configured" status. 

2. For Solaris 8 and 9, use cfgadm -c configure c# command to configure the host to 
access the storage system as shown in the example below. The value of # is gathered from the 
output of the cfgadm -al previously executed. 

Example: 

# cfgadm -c configure c2 

# cfgadm -c configure c3 

3. Execute the cfgadm command to view configured devices. After the configuration, the following 
command will show the array controllers as configured: 



# cfgadm -al 



Ap_ 


.Id 


Type 


Receptacle 


Occupant 


Condition 


cO 




scsi-bus 


connected 


configured 


unknown 


cO 


:dsk/c0t0d0 


disk 


connected 


configured 


unknown 


cO 


:dsk/c0t6d0 


CD-ROM 


connected 


configured 


unknown 


cl 




scsi-bus 


connected 


unconfigured 


unknown 


c2 




f c-f abric 


connected 


configured 


unknown 


c2 


: 50001fel002709f 8 


array-ctrl 


connected 


configured 


unknown 


c2 


: 50001fel002709fc 


array-ctrl 


connected 


configured 


unknown 


c3 




f c-f abric 


connected 


configured 


unknown 


c3 


: 50001fel002709f 9 


array-ctrl 


connected 


configured 


unknown 


c3 


: 50001fel002709fd 


array-ctrl 


connected 


configured 


unknown 
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NOTE: 

Using the option -o show_FCP_dev could result in the output of the cf gadm command to 
display the Type array-ctrl as unconfigured. This is not a problem. (See example below). 



cfgadm -al -o show_FCP_dev 



Ap_Id 
c2 



c2 : 
c2 : 
c2 : 



50001fel002709f 8, 0 
50001fel002709f 8, 1 
50001fel002709f 8, 2 



Type 

f c-f abric 
array-ctrl 
disk 
disk 



Receptacle 

connected 

connected 

connected 

connected 



Occupant 

configured 

unconfigured 

configured 

configured 



Condition 

unknown 

unknown 

unknown 

unknown 



4. Verify that the LUNs/disks are visible with the format command through all the EVA paths. 



# echo | format 
Searching for disks. . 
c2t50 001FE1002 7 0 9F8dl 
c2t50 001FE1002 7 0 9F8d2 
c2t50 001FE1002 7 0 9FCdl 
c2t50 001FE1002 7 0 9FCd2 
c3t50 001FE1002 7 0 9F9dl 
c3t50 001FE1002 7 0 9F9d2 
c3t50 001FE1002 7 0 9FDdl 
c3t50 001FE10027 0 9FDd2 



done 
configured 
configured 
configured 
configured 
configured 
configured 
configured 
configured 



with 
with 
with 
with 
with 
with 
with 
with 



capacity of 

capacity of 

capacity of 

capacity of 

capacity of 

capacity of 

capacity of 

capacity of 



1008 . 
1008 . 
1008 . 
1008 . 
1008 . 
1008 . 
1008 . 
1008 . 



0 0MB 
0 0MB 
0 0MB 
0 0MB 
0 0MB 
0 0MB 
0 0MB 
0 0MB 



AVAILABLE DISK SELECTIONS: 

0. cOtOdO /pci@lf , 4000/scsi@3/sd@0, 0 

1 . c2t500 01FE10 027 0 9F8dl /pci@lf , 4 0 00/QLGC, qla@4 / f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f 8 , 1 

2 . c2t500 01FE10 027 0 9F8d2 /pci@lf , 4 0 00/QLGC, qla@4 / f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f 8 , 2 

3. c2t500 01FE10 027 0 9FCdl /pci@lf , 4 0 00/QLGC, qla@4 / f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f c, 1 

4 . c2t500 01FE10 027 0 9FCd2 /pciSlf , 4 0 00/QLGC, qla@4 / f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f c, 2 

5. c3t500 01FE10 027 0 9F9dl /pci@lf, 4 0 00 / lpf c@5/ f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f 9, 1 

6. c3t500 01FE10 027 0 9F9d2 /pci@lf, 4 0 00 / lpf c@5/ f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f 9, 2 

7 . c3t500 01FE10 027 0 9FDdl /pci@lf , 4 0 00 / lpf c@5/ f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f d, 1 

8 . c3t500 01FE10 027 0 9FDd2 /pci@lf , 4 0 00 / lpf c@5/ f p@ 0 , 0 / ssd@w500 0 1 f elO 02 70 9f d, 2 



Specify disk (enter its number) 



5. Check the multi-pathing information for all LUNs (first example) and either for a given disk/LUN 
or for the array WWN or a port WWN. The multipathing information is already available 
although MPxIO has not yet been enabled: 

# luxadm probe 

No Network Array enclosures found in /dev/es 
Found Fibre Channel device (s) : 



Node WWN: 50001fel002709f 0 Device Type: Disk device 
Logical Path: /dev/rdsk/c2t 500 01FE10 027 0 9F8dl s2 
Logical Path: /dev/rdsk/c2t 500 01FE10 027 0 9FCdls2 
Logical Path: /dev/rdsk/c3t 500 01FE1 0 02 7 0 9F 9dl s2 
Logical Path: /dev/rdsk/c3t 500 01FE10 027 0 9FDdl s2 

Node WWN : 50001f el002709f 0 Device Type: Disk device 
Logical Path: /dev/rdsk/c2t 500 01FE10 027 0 9F8d2 s2 
Logical Path: /dev/rdsk/c2t 500 01FE10 027 0 9FCd2 s2 
Logical Path: /dev/rdsk/c3t 500 01FE10 027 0 9F 9d2 s2 
Logical Path: /dev/rdsk/c3t 500 01FE10 027 0 9FDd2 s2 

# luxadm display /dev/rdsk/c2t 500 01FE1 0 027 0 9F8dl s2 

DEVICE PROPERTIES for disk: /dev/ rdsk/ c2 t 5 0 0 0 1FE1 0 0 2 7 0 9F8dl s2 

Vendor: HP 

Product ID: HSV210 

Revision: 5100 

Serial Num: Unavailable 

Unformatted capacity: 1024.000 MBytes 



MPxIO for Sun Solaris 7 



Read Cache : Enabled 

Minimum prefetch: 0x0 

Maximum prefetch: 0x0 
Device Type: Disk device 
Path (s) : 

/dev/rdsk/c2t500 01FE10 02 70 9F8dls2 

/devices/pci@lf , 4 0 00/QLGC, qla@ 4/ fp@0,0/ssd@w5 0001 fe 1002709 f 8, 1 : c, raw 

LUN path port WWN : 50001f el002709f 8 

Host controller port WWN: 210000e08bl759bd 

Path status: O.K. 
/dev/rdsk/c2t500 01FE10 02 70 9FCdls2 

/devices/pci@lf , 4 0 00/QLGC, qla@4/fp@0,0/ssd@w50001fel002709fc,l:c, raw 

LUN path port WWN: 50001f el002709f c 

Host controller port WWN: 210000e08bl759bd 

Path status: O.K. 
/dev/rdsk/c3t500 01FE10 02 70 9F9dls2 

/devices/pci@lf , 4 0 00 /lpf c@ 5 / f p@ 0 , 0/ssd@w50001fel002709f9,l:c, raw 

LUN path port WWN: 50001f el002709f 9 

Host controller port WWN: 10000000c93d5cee 

Path status: O.K. 
/dev/rdsk/c3t500 01FE10 02 70 9FDdls2 

/devices/pci@lf , 4 0 00 /lpf c@ 5 / f p@ 0 , 0/ssd@ w5 0001 fe 1002709 f d, l:c, raw 
LUN path port WWN: 50001f el002709f d 

Host controller port WWN: 10000000c93d5cee 
Path status: O.K. 

Errors for Solaris 8, 9, and 10 

You will see error messages similar to the following for each EVA controller for LUN 0 on the console 
and in /var/adm/messages. You can ignore these error messages. 

May 18 15:10:30 simonb fcp: [ID 305930 kern . warning] WARNING: fpl : no 
driver for device @w50001fel002709e8, 0 : 

May 18 15:10:30 simonb compatible: scsiclass, 0c . vHP .pHSV210 . r5100 
scsiclass, 0c. vHP . pHSV2 1 0 scsa,0c.bfcp scsiclass, 0c scsiclass 

May 18 15:10:30 simonb scsi: [ID 243001 kern . warning] WARNING: 
/pseudo/ f cp@ 0 (fcpO) : 

May 18 15:10:30 simonb Create devinfo failed. 

Enabling MPxIO 

To enable MPxIO for HP storage devices, the appropriate information for device-type-scsi- 

options-list need to be added in the /kernel/drv/scsi_vhci . conf file. 

1. Use a text editor to change the configuration file, e.g. 

# vi /kernel/drv/scsi_vhci . conf 

2. With Solaris 8 or 9 only you need to change the mpxio-disable parameter to the following: 

mpxio-disable="no" ; 

3. Verify that the load-balance and auto-failback parameters are set to the following values (the default 
setting may vary depending on the patch level / OS version): 

load-balance="round-robin" ; 

auto-f ailback="disable" ; 

4. Add the following lines to cover all HP arrays: 
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device-type-scsi-options-list = 
"HP HSV101", "symmetric-option", 

"COMPAQ HSV111", "symmetric-option", 
"HP HSV2 " , "symmetric-option", 

"HP OPEN", "symmetric-option"; 

symmetric-option = 0x1000000; 

If NOTE: 

Enter six spaces after "HP" and two spaces after "COMPAQ". 



5. Depending on the Solaris version, you need to do the following: 

a. With Solaris 8 or 9 you need to run a reconfiguration reboot in order to activate the changes: 

# reboot — -r 

b. With Solaris 1 0 you need to run the stmsboot command and confirm the reboot: 

# stmsboot -e 



Verify the MPxIO configuration 

After the system has rebooted, use the format or luxadm command to verify that the MPxIO 
enablement has been successful. 



W NOTE: 

In the format or luxadm output, controllers c2 and c3 no longer show up. A single, virtual controller 
path such as c4 now displays the MPxIO-configured LUNs. The cf gadm output does NOT change 
after the MPxIO enablement. 



1. Verify with either format or luxadm probe that only one device file is shown for each LUN: 

# echo | format 
Searching for disks ... done 

c4t600508B400102E640000B000081C0000d0 : configured with capacity of 1008.00MB 
c4t600508B400102E640000B00008100000d0 : configured with capacity of 1008.00MB 

AVAILABLE DISK SELECTIONS: 

0. cOtOdO /pci@lf , 4000/scsi@3/sd@0, 0 

1 . c4t60050 8B4 0 0102E64 0 00 0B00 00 81C0 00 0d0 

2 . c4t60050 8B4 0 0102E64 0 00 0B00 00 8100 00 0d0 
Specify disk (enter its number) : 

# luxadm probe 
No Network Array enclosures found in /dev/es 

Found Fibre Channel device (s) : 

Node WWN : 50001f el002709f 0 Device Type:Disk device 

Logical Path: /dev/rdsk/c4t60050 8B4 0 0102E64 0 00 0B00 00 81C00 00d0s2 

Node WWN : 50001f el002709f 0 Device Type:Disk device 

Logical Path: /dev/rdsk/c4t60050 8B4 0 0102E64 0 00 0B00 00 81000 00d0s2 

2. Check the different paths with the luxadm display command (either for a given disk or for 
the array WWN or a port WWN): 

# luxadm display 50001f el002709f 0 

DEVICE PROPERTIES for disk: 5 0 0 0 1 f e 1 0 02 7 0 9 f 0 



/scsi_vhci/ssd@g600508b400102e640000b000081c0000 
/scsi_vhci/ssd@g600508b400102e640000b00008100000 
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Vendor : 

Product ID: 

Revision : 

Serial Num: 

Unformatted capacity: 

Read Cache : 

Minimum prefetch: 
Maximum prefetch: 

Device Type: 

Path (s) : 



HP 

HSV210 
5100 

Unavailable 

1024.000 MBytes 

Enabled 

0x0 

0x0 

Disk device 



/dev/rdsk/c4t600508B400102E640000B000081C0000d0s2 
/devices/scsi_vhci/ssd@g60 0508b4 00102e64 00 00b0 00 0 81c00 00 : c, raw 



Controller 

Device Address 

Host controller port 

Class 

State 

Controller 

Device Address 

Host controller port 

Class 

State 

Controller 

Device Address 

Host controller port 

Class 

State 

Controller 

Device Address 

Host controller port 

Class 

State 



WWN 



WWN 



WWN 



WWN 



/devices/pci@lf , 4 0 00/QLGC, qla@4/fp@0, 0 

50001fel002709f 8, 2 

210000e08bl759bd 

primary 

ONLINE 

/devices/pci@lf , 4 0 00/QLGC, qla@4/fp@0, 0 

50001fel002709fc, 2 

210000e08bl759bd 

primary 

ONLINE 

/devices/pciOlf, 4 0 00 /lpf c@ 5 / f p@ 0 , 0 

50001fel002709f 9, 2 

10000000c93d5cee 

primary 

ONLINE 

/devices/pciOlf, 4 0 00 /lpf c@ 5 / f p@ 0 , 0 

50001fel002709fd, 2 

10000000c93d5cee 

primary 

ONLINE 
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